Data movement optimizations for independent MPI I/O on the Blue Gene/Q
نویسندگان
چکیده
منابع مشابه
Utilizing In-Memory Storage for MPI-IO
In contrast to disk or flash based storage solutions, throughput and latency of in-memory storage promises to be close to the best performance. Kove®’s XPD® offers pooled memory for cluster systems. However, the system does not expose access methods to treat the memory like a traditional parallel file system that offers POSIX or MPI-IO semantics. Contributions of this poster are: 1. Implementat...
متن کاملThe Impact of File Systems on MPI-IO Scalability
As the number of nodes in cluster systems continues to grow, leveraging scalable algorithms in all aspects of such systems becomes key to maintaining performance. While scalable algorithms have been applied successfully in some areas of parallel I/O, many operations are still performed in an uncoordinated manner. In this work we consider, in three file system scenarios, the possibilities for ap...
متن کاملMpi-io Implementation Strategies for the Cenju-3
The lack of a portable parallel I/O interface limits the development of scientiic applications. MPI-IO is the rst widespread attempt to alleviate this problem. Its eecient implementation requires the developer to face and solve several software design and interface issues. Our paper outlines strategies, which may be helpful in this task. Although originally targeted for the NEC Cenju-3, our con...
متن کاملCompiler Optimizations for Non-contiguous Remote Data Movement
Remote Memory Access (RMA) programming is one of the core concepts behind modern parallel programming languages such as UPC and Fortran 2008 or high-performance libraries such as MPI-3 One Sided or SHMEM. Many applications have to communicate noncontiguous data due to their data layout in main memory. Previous studies showed that such non-contiguous transfers can reduce communication performanc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Parallel Computing
سال: 2017
ISSN: 0167-8191
DOI: 10.1016/j.parco.2016.07.002